A FUZZY LOGIC METHOD FOR ADAPTTVELY EVALUATING 
THE VALIDITY OF SENSOR DATA 



BACKGROUND OF THE INVENTION 

Fuzzy logic has been applied to many different types of problems since 
introduced by Zadeh in 1965. Unlike Boolean logic, fuzzy logic is suited to 
evaluating subjective situations. For agriculture, the subjectivity of fuzzy logic is 

5 particularly appealing (Ribeiro, 1999, Wang, 1996, Zhang and Litchfield, 1991, 

1994). Field conditions - weather, the position and intensity of the sun and dust, just 
to name a few - and crop conditions - size, shape, weed and pest pressure - combine 
to create a difficult situation for conventional evaluation methods. For example, 
given a pile of fruit, we can separate apples and oranges. If we are looking at a 

10 Jonamac apple, our description might include red, a hint of green and a mostly round 
shape. If we look at a Granny Smith apple, the description might include green, 
smooth and oblong. An orange might have an orange color, a rough texture and 
round as descriptors. While we can verbally describe apples and oranges, it's much 
more difficult to create a mathematical description of an apple or orange that will 

1 5 apply for all situations. The variability common in agriculture makes fuzzy logic 

appealing. Fuzzy logic is based on set theory. In Boolean set theory, a value either is 
or is not a member of a set. In fuzzy logic, the member can be partially a member of a 
set. For example, a Granny Smith apple is partially round. The apple might have a 
value of |Igs( x ) round and (1 - |J.gs( x )) not round. Each element - or in this case, 

20 fruit in the pile - is evaluated independently based on a set of membership functions. 
The membership functions are used to describe the classes in question. The 
membership functions stem from the linguistic classes used to describe the items. The 
number of membership classes and the membership functions within the class will 
vary with the situation. In the fruit example, membership classes might include 

25 roundness, a color index and surface texture. Within the roundness class, there may 



2 



be two functions (round / not round) while other classes (color index) may require 
more functions to adequately describe the situation. With Boolean logic, an element 
is either a member of the class (1) or it is not (0). With fuzzy logic, an element can 
partially belong to multiple classes. For any two fuzzy sets (SI and S2), three basic 
5 operations can be defined. 

Intersection: 



^sioS2 = min{|^si(u), |a S2 (u)} 



Union: 



^siuS2 = max{nsi(u), ^S2(u)} 



10 Complement : 



In machine vision, variability in the target and scene make fuzzy logic 
attractive. Machine vision is one of the primary sensors for an ongoing agricultural 
vehicle guidance project at the University of Illinois at Urbana - Champaign. Sensors 
1 5 have included machine vision, GPS, and a variety of heading sensors (Stombaugh, et 
al, 1998, Benson, et al. 9 1998, Noguchi, et al, 1998). 

Sensor fusion - specifically Kahnan filtering - has played an important role in 
the project. With an extended Kalman filter, an estimator calculates the expected 
states of the vehicle based on the most recent state information. An observer 
20 evaluates the sensor output and it is validated against the estimated output. A large 
difference between the expected and actual sensor value is indicative of a problem 
with the sensor or sensor processing (Hague and Tillett, 1996). 

A variety of methods can be used to evaluate the output from the sensor. 
Noguchi, et al, (1998) described a probability density approach, in which the sensor 
25 variability was characterized a priori. A predetermined probability, however, cannot 
account for situational variations. An adaptive, or "on-the-fly" system, can account 
for changes in the scene. 
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An adaptive system uses flexible parameters to evaluate the sensor output. 
The nature of the evaluation parameter depends on the system. An internally 
referenced parameter, for example standard deviation of the output, can be used to 
detect significant outliers. An example of an adaptive evaluation system is presented 
5 in this application. An externally referenced parameter could be tied to another 
sensor. An example would be comparing the heading from a fiber optic gyro to the 
heading from a time series of GPS positions to determine whether the fiber optic gyro 
signals were indeed valid. In a system like this, the heading from the fiber optic gyro 
would provide the raw sensor data, and the time series would be the estimated sensor 
10 data, as those terms are used below. 

In contrast, a fixed membership function cannot account for variability. In 
^ agriculture, weather, weeds and other field conditions can cause changes in sensor 

II output. A fixed threshold is harshly optimistic (actual sensor output never meets the 

\j actual conditions), too generous (the system never encounters a unacceptable value), 

15 or somewhere in-between. In this application, a generic fuzzy quality analysis 
|j module is presented. The module was developed and used to evaluate simulated 

^ * sensor data. 

fl ] Ideally, sensors should always produce high quality, repeatable measurements. 

J ! Unfortunately, real world variations can cause sensor errors. With only a single 

p 20 sensor, it can be difficult to tell when there is a problem with the sensor. With 

f " multiple sensors, we can begin to compare the results between sensors and determine 

when there is an error. The question can still remain - which sensor is "right" and 
which is "wrong". What is needed is an improved method for determining whether a 
sensor signal is right or wrong. A sensor may not provide a signal that truly indicates 
25 a sensed parameter for many reasons. For example, the sensor or its associated 
circuitry may be broken. The sensor and its circuitry may not be broken, but the 
sensor may have been moved away from the environment it should be sensing to 
another environment, such as a temperature sensor that has been pulled out of its 
environment, or a camera that has been bumped away from its proper field of view. A 
30 sensor may be in the proper location, but may be fouled with environmental matter 
such as stray leaves that fly in front of a camera or an oxygen sensor in a car that has 
become carbon fouled. 
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What is needed is a method for determining whether the signal provided by a 
sensor is valid. It is an object of the application to provide such a method. 

SUMMARY OF THE INVENTION 

In accordance with a first embodiment of the invention, a method for 
determining the validity of a sensor signal is provided, including the steps of 
providing a sensor signal from a sensor, providing an estimated sensor signal, 
determining the difference between the sensor signal and the estimated sensor signal, 
calculating the standard deviation of the difference, scaling the points of inflection of 
a fuzzy logic membership function proportional to the standard deviation, and 
processing the sensor signal using the fuzzy logic membership function to determine 
whether the sensor signal is valid or not. 

The step of processing may occur before the step of scaling or the step of 
scaling may occur before the step of processing. The fuzzy logic membership 
function may have at least two domains, including at least one domain that evaluates a 
sensor signal as acceptable, and at least one domain that evaluates a sensor signal as 
unacceptable. The step of scaling may include the step of multiplying each of at least 
two points of inflection of the fuzzy logic membership function by the standard 
deviation. 

In accordance with a second embodiment of the invention, a method for 
determining the quality of a sensor signal in a fuzzy logic controller is provided, 
including the steps of providing a first cumulative scatter value indicative of a 
cumulative degree of difference between a plurality of sensor signal values and 
estimated sensor signal values corresponding to each of the sensor signal values, 
providing a fuzzy logic membership function in which the x-axis values of the points 
of inflection of a plurality of fuzzy logic domains are derived from the first 
cumulative scatter value, retrieving a further sensor signal value, comparing the 
further sensor signal value with a further estimated sensor signal value, calculating a 
further scatter value indicative of the individual degree of difference between the 
further sensor signal value and the further estimated sensor signal value, combining 
the further scatter value with the first cumulative scatter value to provide a second 
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cumulative scatter value indicative of the cumulative degree of difference and the 
individual degree of difference in combination, and revising the fuzzy logic 
membership function such that the x-axis values of the points of inflection of the 
plurality of fuzzy logic domains are derived from the second cumulative scatter value. 

The step of providing a first cumulative value may include the steps of 
calculating a first difference between a first of the plurality of sensor signal values and 
a first of the estimated sensor signal values, calculating a second difference between 
a second of the plurality of sensor signal values and a second of the estimated sensor 
signal values, and calculating the first cumulative scatter value from at least the 
foregoing first and second differences. The first cumulative scatter value may be a 
function of the standard deviation of the first and second differences. 

In accordance with a third embodiment of the invention, a method of 
individually determining whether a plurality of sequential sensor values are valid is 
provided, including the steps of reading a sensor value determining a degree of 
difference between the sensor value and an estimated sensor value revising the size 
and shape of a fuzzy logic membership function that is responsive to the degree of 
difference as an input and produces a signal indicative of the validity of the sensor 
value as an output determining whether the sensor value is valid, and repeating each 
of the foregoing steps for each of the plurality of sequential sensor values. 

The method may also include the steps of calculating a value indicative of the 
collective degree of scatter of the individual degree of differences previously 
calculated. The step of calculating may be performed after each step of determining a 
degree of difference, and wherein the value indicative of the collective degree of 
scatter incorporates all of the previous individual degrees of difference. The value 
indicative of the collective degree of scatter may be a standard deviation of prior 
degrees of difference previously calculated. The x-axis values of the membership 
function may themselves be functions of the standard deviation. The method may 
also include the step of calculating a plurality of the x-axis values every time the step 
of calculating a value indicative of the degree of scatter occurs. Each of the x-axis 
values of the points of inflection may be associated with a value that is a function of 
the collective degree of scatter. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully understood from the following 
detailed description, taken in conjunction with the accompanying drawings, wherein 
like reference numerals refer to like parts, in which: 

5 FIGURE 1 is a block diagram of a theoretical fuzzy logic sensor signal 

validity determining circuit; 

FIGURE 2 illustrates the automatic adaptation circuit of the rulebase of 
FIGURE 1 showing how it accommodates changes in the signal level by changing the 
points of inflection of the membership functions based upon the statistical scatter of 
10 the difference between a raw sensor signal and an estimated value of that signal; 

FIGURE 3 illustrates the simulator circuit that generates an estimated sensor 
signal (the "estimated output") and a raw sensor signal (the "actual output"); 

FIGURE 4 A is an input membership function for the rulebase of FIGURE 1 
having a wide acceptance level; 

1 5 FIGURE 4B is an alternative input membership function for the rulebase of 

FIGURE 1 having a narrow acceptance level; 

FIGURE 5 is a plot of a data set of sensor values processed using the wide 
input membership function of FIGURE 4 A showing all the individual datapoints 
comprising the sensor values. These datapoints are identified as acceptable ("o") or 
20 unacceptable ("x"); 

FIGURE 6 is a plot of a data set of sensor values processed using the narrow 
input membership function of FIGURE 4B showing all the individual datapoints 
comprising the sensor values. These datapoints are identified as acceptable ("o") or 
unacceptable ("x"); 

25 FIGURE 7 is table that compares the validity of the raw sensor values as 

compared with estimated sensor values using two methods, the fuzzy logic validity 
method and a manual comparison method; 
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FIGURE 8 is a table that shows the percentage of agreement between the 
manual method and the fuzzy logic method by showing the percentage of datapoints 
for which both methods were in agreement; and 

FIGURE 9 is a flowchart illustrating the fuzzy logic sensor signal validity 
determination method. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the discussion below we explain how the method of determining the 
validity of a sensor signal was simulated and tested to determine is viability. This was 
done by using a set of data created specifically for this purpose and saved to a 
computer file. 

To devise a system to determine whether or not a sensor signal is valid (i.e. 
acceptable or unacceptable) and therefore whether or not it should be used in further 
computer processing, the first step is to develop a general structure of such a system 
and determine its feasibility. In this first step we developed a generic fuzzy quality 
module that can evaluate sensor output. The general structure of this module is 
shown in FIGURE 1. 

In FIGURE 1 , a signal whose quality or validity is to be determined is placed 
on input line 102. This signal is fuzzified in block 104 where it is converted into 
memberships in two or more fuzzy sets. A fuzzy logic inference engine then applies a 
plurality of rules from a rulebase to the set memberships in block 106. These rules 
have been empirically developed to determine whether or not the signal is valid or 
not. The output of the inference engine is then defuzzified in block 108 to provide a 
single output indicative of whether the signal is valid or not. If the signal is valid, it 
may then be used in further processing to automatically control some process. If not, 
it is discarded and is not used for process control. In the present application, the 
example sensor is a fiber optic gyro that provides a heading signal and the further 
processing is trajectory planning for automatic vehicle guidance. The specific sensor 
and application are merely exemplary, however, and form no part of the inventive 
method. 
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The structure shown in FIGURE 1 is flexible and can be easily applied to 
different problems by changing the number and type of membership functions. While 
the system shows a single input (for convenience of illustration), several signals may 
be fiizzified and collectively processed by the inference engine by the addition of 
5 several more input fuzzification blocks and adding additional rules to the rulebase 
used by the fuzzy logic inference engine. 

To increase the generality and flexibility of the fuzzy quality analysis module, 
the generic fuzzy module was developed to simultaneously process sensor signals 
from many sensors. While only a single sensor signal is shown as an input in FIGURE 
10 1 , the number of signals that can be simultaneously validated is limited only by the 
bandwidth of the processor used to apply the fuzzy logic algorithm. 

The default design used trapezoidal membership functions (FIGURES 4A and 
4B). Trapezoidal membership functions were chosen to simplify coding and tuning. 
The membership functions were initially read from a file; C functions were developed 
15 to allow the input and/or output membership functions to be changed during 
execution. 

Changing the membership functions during execution allows the membership 
functions to be adaptively tuned for optimal performance. Examples of adaptive 
membership functions are shown in FIGURES 4 A and 4B. As the number of inputs 
20 increases, it becomes increasingly difficult to organize and manage an explicit rules 
base. For example, with a four input system (as shown in the machine vision example 
below), a four dimensional space would be required to explicitly create the rules base. 
For this reason, each input was evaluated independently. 

The input/output relationship was established by defining a mapping from the 
25 fuzzy input function to an appropriate fuzzy output function. The mapping was of the 
form "fuzzy input category X" is processed with "fuzzy output category Y". Each 
input category was assigned a varying fitness level from 0 to 1 based on the relative 
position within the membership function. 

Defuzzification converted the fuzzy linguistic output into a crisp output. The 
30 fitness level was used to determine the relative strength of the appropriate output 
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membership function. A center of gravity approach was used to process the varying 
fitness output functions. The output from the individual inputs was summed together 
to create a composite output. The specific implementations of both systems are 
described below. 

5 The goal was to develop and evaluate a fuzzy validation model that can be 

adapted for use with for many different types of sensors and signal values. For this 
reason, the overall structure shown in FIGURE 1 does not replicate a specific system 
using a specific sensor type or a specific number of sensors, but rather a single fuzzy 
logic based validation system that can produce a single output indicating the 
10 acceptability of a sensor signal. 

The intent is to show that a fuzzy logic validation technique can be applied to 
any arbitrary sensor. A system suitable for an arbitrary sensor can then be transferred 
to a specific sensor with relative ease. The simulation code, including the test signal 
and the fuzzy evaluation module, was written in C. 

15 A fixed set of rules in the rulebase cannot accommodate a sensor signal that 

may vary over time. For example, some sensors have a significant amount of noise. 
As mentioned above in the Background, Kalman filtering has been used in the past to 
accommodate these signal values and estimate the true sensor level. Any fuzzy logic 
system that wishes to approach the flexibility and discriminating power of Kalman 

20 filtering must also be able to accommodate a noisy signal. 

The rules in the rulebase of FIGURE 1 are therefore dynamically adapted to 
accommodate changes in the sensor signal. As the noise components of the signal 
predominate, the rulebase is redefined to accommodate the additional noise by 
widening the range of what is considered valid. If the signal has less noise, the 
25 rulebase is redefined to accommodate the reduced noise levels by narrowing the range 
of what is valid. 

A statistical analysis was devised to automatically adapt the rules in the 
rulebase. This analysis determines the degree of scatter in the raw signal data as 
compared to the estimated sensor data. The output of this statistical analysis was then 
30 used to modify the rules in the rulebase dynamically, as sensor signal data values 
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were received (in this case received from a data file previously generated). 

FIGURE 2 illustrates the process and circuit for automatically adapting the 
rules in the rulebase. An estimated signal value ("Estimated Output" in FIGURE 2) is 
provided on line 202. The raw signal value ("Actual Output" in FIGURE 2) is 
5 provided on line 204. These two values are differenced in block 206 to provide a 
difference (or error) signal on line 208. This error signal is then evaluated in block 
210 to determine whether the raw signal is good or bad. The output of block 210 is a 
validity signal on line 212 that is indicative of whether the signal on line 204 is good 
or bad, and therefore whether it should be ignored or used in further processing. 

10 As each new error signal is generated, it is also processed in block 2 14 to 

generate the standard deviation of the error signal. The greater the scatter in the error 
signal, the greater the value of the standard deviation. In block 216, this standard 
deviation is applied to the membership functions of the rulebase (FIGURE 1) to adapt 
the membership functions of the rulebase in accordance with the degree of scatter in 

1 5 the error signal. It is this adaptation of the rulebase that lets the system accommodate 
sensor signals that have greater or lesser degrees of scatter as time goes by. 

The circuit by which the estimated output and actual output signals were 
produced is illustrated in FIGURE 3. A sine wave generator circuit 302 produced a 
sine wave on signal line 304. The sine wave signal on line 304 was then applied to 
20 line 202 of FIGURE 2 as the estimated output signal. 

The circuit that manufactures the actual output signal (the raw sensor signal) is 
also shown in FIGURE 3. The sine wave signal from generator 302 is applied to 
summation block 306 where it is combined with two simulated noise components 
generated by positive noise circuit 308 and negative noise circuit 310. It is this 
25 combined signal &at wa s - ^avod to filo and u sed as the actual output signal (the raw 1{7J*Iq\ 
sensor signal). . , t _ 

Positive noise circuit 308 includes a gain signal circuit 312 that generated a 
signal on line 3 14 that is indicative of a simulated amplitude of positive noise. This 
gain signal was, in turn, transmitted to a random noise source 316 which generated a 
30 normalized random noise component. The output of source 3 1 6 is a positive random 
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noise component that is supplied to summation block 306 which adds it to the sine 
wave signal. 

Negative noise circuit 310 includes a similar gain signal circuit 318 that is 
similarly coupled to a random noise circuit 320 and thence similarly transmitted to 
5 summation block 306 where it is subtracted from the sine wave signal. The output of 
the summation block is then applied to the actual output line 204 of FIGURE 2. 

The circuit of FIGURE 3 illustrates a typical sensor signal that has a nominal 
sensor signal and a noise component. In this circuit, the sensor that is simulated 
provides a time varying signal, for convenience modeled here as a pure sine wave. 
10 For purposes of validating the method, however, this simulated signal is sufficient. 

The nominal output from the simulated sensor was a 100-unit sine wave. An 
arbitrary, unitless scale was chosen for the simulated sensor signal. Incorporating 
positive and negative noise simulated a 'noisy' sensor. The noise terms were seeded 
independently each iteration of the simulation. 

1 5 The noise terms had a range of -25.0 to +25.0 (\i= -0.646, a = 0.289). The 

additive noise gave the simulated sensor a slight negative bias, simulating an offset 
configuration or installation. Modeling an input signal was not the goal of the project; 
therefore an ideal estimator was assumed. 

The estimator was implemented as the 'clean' or nominal sine wave. As 
20 shown in FIGURE 2, the difference (or error) between the actual and estimated sensor 
output, was used as the input to the validation module. 

In this manner two input signals are generated, (1) a sine wave estimated 
sensor output signal and (2) a sine wave + positive noise + negative noise actual 
sensor output signal. The difference between the two signals is therefore a positive 
25 going and negative going random noise component. Hence, referring back to 

FIGURE 2, the error signal (i.e. the difference between the estimated output and the 
actual output) is a random noise component having both negative going and positive 
going components. 

To test the fuzzy logic validation method, both the estimated output (the sine 
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wave signal) and the actual output (the sine wave-plus-noise signal) were produced to 
create several runs of several hundred pairs of values each (i.e. the estimated sensor 
value and the corresponding raw sensor value). These runs of several hundred pairs 
of values were digitally stored in computer files. 

5 Graphical plots of two of these simulation runs are shown in FIGURES 5 and 

6. The sine wave signal (the estimated output) is shown as sine waves 502 and 602 in 
FIGURES 5 and 6, respectively. The sine wave signal can be considered a pure or 
perfect estimated sensor value. 

The sine wave-plus-noise signal is shown as the data points 504 and 604 in 
10 FIGURES 5 and 6, respectively. Note that the data points in both FIGURES 5 and 6 
are shown both as dots and as small crosses. The dots represent the data points that 
the circuit of FIGURES 1 and 2 evaluated as acceptable or valid, and the crosses 
represent data points determined as unacceptable or invalid. The way in which this 
validation was performed will be discussed in more detail below. For the moment it 
15 is enough to know that all the data points in both FIGURES 5 and 6, regardless of 
their shape, represent a sine wave-plus-noise value, an "actual output" (FIGURE 2) 
value and graphically illustrate just two of the simulated sensor data sets (estimated 
and raw sensor values) created using the circuit of FIGURE 3. 

Referring back to FIGURE 2, once the standard deviation (more generally the 
20 value indicative of the degree of scatter in the differences between estimated sensor 
values and actual sensor values) is calculated in the statistical processing circuit 214, 
it is then used to adapt the rules in the fuzzy logic rulebase 104 used to validate each 
sensor value. The rules in the rulebase are graphically shown in FIGURES 4A and 
4B. The circuit that performs the adaptation is item 216 in FIGURE 2. 

25 Referring now to FIGURES 4 A and 4B, two membership functions for 

evaluating the validity of the sensor data are illustrated. These FIGURES represent 
rules in the rulebase of FIGURE 1 . In both FIGURES, the membership function 
includes three trapezoidal domains that are symmetric about a value of zero error. 
"Error" (represented as in FIGURES 4A and 4B) refers to the difference between 

30 the raw sensor signal and the estimated sensor signal that is provided on signal line 

208 of FIGURE 2. 
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There are three domains in each of these membership functions. The first is a 
central acceptable domain 402, 404 that is symmetric about an error value of zero. 
An error value of zero is achieved whenever the difference between the estimated 
output of the sensor is equal to the actual output of the sensor. Clearly, when the 
5 actual value and the estimated value are the same we have the canonical case wherein 
a sensor signal would be considered acceptable. 

On either side of the central acceptable domains, are symmetrical 
unacceptable domains, 406, 408, 410, 412. Each of these domains is a mirror image 
of the other with respect to the central error value of zero. As the error increases, 
10 eventually these regions are reached and the corresponding raw sensor value (actual 
output) will be evaluated as unacceptable. 

Note that the points of inflection of both the acceptable domains and the 
unacceptable domains projected onto the x-axis are identified not with constant error 



£5 



values, but by a constant value times sigma (a)* Sigma represents the standard f 
1 5 deviation of the error. More generally it represents a value indicative of the degree of 

scatter in the sequentially calculated error values. ^ 

In FIGURE 4A, the values are -2a, -la, 0, 1 a, and 2 a. In FIGURE 4B the f 
values are -la, -1/2 a, 0, 1/2 a, and 1 a. Generally sneaking these can be thought of 

as the more general case of [-2Cia, - Cia, Qa, 2C\o/ where Ci = 1 in FIGURE 4A, V2&/0 1 

20 and Ci = V2 in FIGURE 4B. ^(L. 



As we explained above, every time a new sensor value is retrieved, the 
standard deviation of the error is recalculated. The values for the standard deviation 
are substituted into the membership functions and the x-axis values of the points of 
inflection for each of the domains are recalculated accordingly. This occurs in block 
25 216 of FIGURE 2. 

The result is that the membership functions adapt to respond to changes in the 
degree of scatter in the error. 

Comparing FIGURES 4 A and 4B, one can see that different sensors may be 
provided with different membership functions. FIGURE 4 A illustrates a sensor with 
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a broad degree of acceptability, as indicated by the wide range of its acceptable 
domain from -2a to 2a. The sensor of FIGURE 4B has a narrower acceptable domain 
of -la to la. We can therefore expect many more sensor values to be rejected using 
the membership function of FIGURE 4B than for the function of FIGURE 4 A. 

5 The generic fuzzy quality analysis module used the adaptively tuned 

membership functions to evaluate the sensor data in block 210. Again, the sensor data 
was the data previously developed and stored in a file. The results of this simulation 
are shown in FIGURES 5 and 6. The output membership functions were iteratively 
tuned to provide a positive output for acceptable data (acceptable) and a negative 

1 0 output for unacceptable data (unacceptable). The two different width adaptive 
membership functions (FIGURES 4A and 4B) were simulated. The sensor 
variability, represented by the standard deviation of the error (a), indicated the 
relative distribution of the data. The smaller the variation, the more apparent a single 
outlier becomes; conversely, increasing the variability makes it more difficult to 

1 5 detect outliers. For both systems, both fuzzy logic membership functions, the 

standard deviation of the error was updated at each iteration through the loop and used 
to continually adjust the width of the membership functions. Four points on the x- 
axis (FIGURES 4A and 4B) defined the acceptable or acceptable sensor region: [- 
2Cia, - Cia, Cia, 2Cia], Ci was a width parameter that was used to vary the zone of 

20 acceptance. 

For the first case, shown in FIGURE 5 (and using the membership function of 
FIGURE 4 A having a wide acceptability), Ci was set to 1, creating a zone of 
acceptance that was described by [-2a, -a, a, 2a]. 

For the second case, shown in FIGURE 6 (and using the membership function 
25 of FIGURE 4B having a narrow acceptability), Ci was decreased to V£, forming a 
zone of acceptance that was described by [-a, - Vz a, Vi a, a]. Outside the first 
parameter, the fitness value was zero. 

The fitness value increased linearly from the first parameter (-2Cia) to the 
second parameter (-Cia). From the second parameter to the third parameter (Cia), the 
30 fitness value remained constant at a maximum fitness of 1 . The fitness value 
decreased linearly from the third parameter to the fourth parameter (2Cia). The 
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unacceptable (unacceptable) regions were defined to overlap the outer two parameters 
as shown in FIGURES 4A and 4B. They were also linear between -2Cic and -Cio as 
well as between C\o and 2Cia but with the identical (but negative) slope. 

Referring now to FIGURES 5 and 6, shrinking the zone of acceptance 
increased the number of data points rejected by the system as indicated by the 
increased number of signal values marked with "x". The zones of acceptance were 
used both for adaptively tuning the membership functions and to evaluate the 
performance of the algorithm. The simulation was repeated five times for both the 
narrow and wide adaptive classes. Each simulation was 499 iterations, one iteration 
for each of the data points shown in FIGURES 5 and 6. 

Representative results for the wide adaptive class are shown in FIGURE 5. 
Representative results for one of the narrow adaptive class simulations are shown in 
FIGURE 6. The points indicated with an "x" were considered unacceptable by the 
fuzzy quality analysis system. 

The progressive adaptation of the system to the changing degree of scatter in 
the data can be seen in both FIGURE 5 and FIGURE 6. In both cases, the standard 
deviation of the error was initially low, creating a narrow adaptive acceptance region. 
This narrow region led to an increased rejection rate early in the simulation. This can 
be seen by the high rejection rate on the left side of the graphs of FIGURES 5 and 6. 

As the simulation progressed, the adaptive regions reached a stable width. In 
FIGURES 5 and 6, the system rejected more points early on; as the system built a 
history of the prior results (i.e. as it repetitively modified the membership functions 
with each iteration), the rejection rate decreased, and only significant outliers were 
discarded. 

EVALUATION 

The improvement this fuzzy quality analysis method offers can be readily seen 
by comparing the performance of the fuzzy adaptive quality analysis module to a 
crisp manual evaluation scheme — by manually comparing the absolute value of the 
sensor error to the zone of acceptance defined in the membership functions as shown 
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in FIGURES 7 and 8. 

FIGURE 7 compares (a) the results that would have been achieved using two 
crisp zones of acceptance of lCic and 2Cia, with (b) the results achieved by using the 
fuzzy quality analysis method described above. 

5 In the first rows of FIGURE 7, the number of datapoints accepted using the 

wide criteria of FIGURE 4A are compared with these two crisp zones (where Ci=l). 

In the lower rows of FIGURE 7 5 the number of datapoints accepted using the 
narrow criteria of FIGURE 4B are compared with the same two crisp zones (where 
Ci=0.5). 

10 The effect was magnified as the width of the acceptance zone decreased. The 

crisp manual evaluation scheme tended to be overly conservative for narrow 
acceptance regions (Cia), rating potentially useable readings as unacceptable. As the 
width of the acceptance region increased (2Ci<j), the crisp manual evaluation scheme 
became overly permissive and rated questionable results as acceptable. In contrast, 

1 5 with the fuzzy system, results that fell between regions were rated accordingly. 

FIGURE 7 shows that the overall number of data point rejections and 
acceptances are substantially the same for both the manual and the fuzzy logic system. 
Nonetheless, the results do not tell us the degree to which each individual datapoint 
was treated in the same manner by both the manual classification method and the 
20 fuzzy logic quality analysis method. 

FIGURE 8 compares the fuzzy quality analysis method with a manual 
classification method on a datapoint-by-datapoint basis by classifying the fuzzy 
quality results as TRUE or FALSE depending on whether the manual and fuzzy 
evaluation schemes agreed. A TRUE result indicates that the manual and fuzzy 
25 evaluation schemes classified a data point the same way. A FALSE result indicates 
disagreement between the two evaluation methodologies. Classification of TRUE or 
FALSE, however, was unaffected by the relative quality of the individual sensor 
readings; classification depended only on the agreement between the two methods. 

A comparison between the two evaluation schemes indicates average 
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agreement between 82.98% and 87.05%. The highest agreement occurred with the 
narrowest (Narrow do) classes, which tended to reject both evaluation schemes 

The simulation shows that a fuzzy evaluation scheme can be used to validate 
sensor output. Adaptive membership functions allowed the definition of acceptability 
5 to be related to the current performance of the system. 

The method that was simulated above indicates that a fuzzy quality evaluation 
method is workable and provides results that are comparable to a manual 
classification method. 

Referring now to FIGURE 9 you can see a flow chart of the steps performed 

1 0 by the fuzzy logic sensor data validation method. In block 902, the process begins. 
The first step is shown in block 904 in which a raw sensor value is retrieved from the 
sensor. Again, this can be any sensor. In block 906, an estimated sensor value is 
retrieved. In block 908, the method determines the degree of scatter between the raw 
and the estimated sensor values. In block 910, the fuzzy logic rulebase is modified or 

1 5 adapted based upon the degree of scatter indicated in block 908 . In block 912, the 
modified rulebase is used to evaluate the current sensor value to determine its validity 
or invalidity. In block 914, the sensor value is rejected if invalid and accepted if 
valid. In block 916, the system determines whether or not there are additional sensor 
values. If so, it begins the process again at block 904 where it retrieves a second 

20 sequential (in time) sensor value and repeats the process. If there are no more sensor 
values, the process is halted in block 918. In the preferred embodiment, this 
algorithm will be implemented on a digital microcomputer or microcontroller. The 
sensor signal, while it may be received from previously gathered data, will preferably 
be transmitted to the computer in real time as the sensor responds to additions in the 

25 changing conditions in the sensed environment. In the preferred embodiment, when 
the sensor value is rejected it will merely be ignored in subsequent processing steps. 
Subsequent processing steps may include a wide range of automatic activity, typically 
executed by an appropriately programmed microprocessor or microcontroller. An 
example of such a process is trajectory planning algorithm that determines what 

30 direction an agricultural vehicle should turn in order to stay on a planned path. A 
typical sensor that might be employed could be a camera for a vehicle navigation 
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system, a heading sensor for such a vehicle, a steering angle sensor for such a vehicle, 
or a GPS receiver for such a vehicle. It should be understood, however, that any 
particular sensor or particular application is not deemed to be within the scope of the 
attached claims as filed. 

5 While the embodiments illustrated in the FIGURES and described above are 

presently preferred, it should be understood that these embodiments are offered by 
way of example only. The invention is not intended to be limited to any particular 
embodiment, but is intended to extend to various modifications that nevertheless fall 
within the scope of the appended claims. 

10 
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